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ABSTRACT 

In  this  paper,  the  authors  proved  that 

lim  |  |(tyv/n)k|  |  <  (l+k)ok,  a.s. 
n-x» 

2 

where  W:  n  x  n  is  a  square  random  matrix  with  l.i.d.  entries  and  o  is  the 

variance  of  the  entries  of  W.  In  proving  the  result,  the  authors  assumed 
the  exi stance  of  fourth  monent  of  the  entries  of  VI. 


Key  words  and  Phrases:  Spectral  radius,  limiting  behavior,  random  matrices. 


1.  INTRODUCTION 


In  the  theory  of  large  random  matrices,  how  to  dominate  the  norm 
of  a  random  matrix  is  a  very  important  problem.  This  is  the  reason  why 
many  authors  are  interested  in  this  problem.  For  interesting  works, 
see  Geman  (1980),  Jonsson  (1983),  Silverstein  (1984)  and  Yin-Bai- 
Krishnaiah  (1984).  In  these  papers,  they  consider  the  norm  of  a  sample 
covariance  matrix,  with  different  moment  requirements.  The  newest 
result  of  Yin-Bai-Krishnaiah  requires  only  the  existence  of  4th  moment. 

In  this  paper ^.wd* consider* a  different  type  of  random  matrices, 
namely  il  ,  i.e.  a  power  of  a  square  random  matrix  with  iid  entries. 

The  first  result  in  this  paper  (Theorem -2t1)  is  "  ^  ** 

*  R. 

lim  (  — )  <_  (l+k)o\  a.s.  (n  is  the  size  of  H)  , 

nr*00  /ii  - 

2 

!  here  o  is  the  variance  of  the  entries  of  W.  Ue  assume  only  the 

existence  of  the  4-th  moment  of  the  entries  of  W.  From  this  result  it 

zc  ■  - 

is  easy  to  show  that  the  spectral  radius  of  W//n  is  not  greater  than  a 

2 

with  probability  1.  This  result  is  known  only  for  lid  N(0,^  )  case. 

L  5  f.  ,  . 

In  proving  the  above  result,  a  new  kind  of  graphs  has  to  be 
discussed  carefully,  ~(k3)\  and  the  truncation  method  used  in  Yin-Bai- 
Krishnaiah  (1984)  is  also  important  here. 

As  applications  of  the  above  result,  we  have  solved  two  open 
problems  announced  in  the  paper  Geman-Hwang  (1982).  The  solutions 
are  in  §  5 ,  §  6  and  §  7  . 
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2.  LIMITING  BEHAVIOR  OF  MATRIX  PRODUCT  NORM 

In  Sections  2-4,  we  will  prove  the  following  theorems. 

Theorem  2.1.  Let  (w^:  1  “  l,2,...,j  »  1,2,...}  be  iid  random 

variables,  and  be  the  n*n  matrix  (w^)  i,j  *  1,2,. ..,n.  Suppose 

E  W11  “  °»  E  wn  *  °2»  E  wii  <  *•  (2.1) 


Then,  for  any  positive  integer  k,  we  have 

y  ,  v 

lim  sup  ||(  — )  ||  <  (k+l)a  a.s.  (2.2) 

n*®  Sn 

Here  ||a||  denotes  the  operator  norm  of  the  matrix  A. 

Denote  by  A^(A),  i  =  l,2,...,n,  the  n  eigenvaluesof  the  n*n 
matrix  A.  We  have 


Theorem  2.2.  Under  the  same  conditions  as  in  Theorem  2.1,  we  have 


lim  sup  max  |A^(  ~ )  I  £  0  a.s. 
n+®  l<i<n 


'  .  v 

1  /n 


Theorem  2.2  can  be  easily  deduced  from  Theorem  2.1  as  follows: 
For  any  integer  k  ^  1,  by  Theorem  2.1, 


lim  sup  max  X.(  — ) 

1  G 


ir*«  l<_i<n 
£  lim  sup 


W_  k 
(  —  ) 


*  lim  sup  max 
n-H»  l<i<n 

1/k 


W  * 

*,[(-=)  ] 


1/k 


<  (k+l)1/ko.  a.s. 


Letting  k  -*■  •  we  get  Theorem  2.2. 


3 .  SOME  LEMMAS 


At  first  we  state  the  following  lemma  which  can  be  found  in  Yin- 
Bai-Kr ishnaiah  (1984). 

Truncation  Lemma.  Let  r  be  a  number  in  the  interval  [*s»2], 

(w^:  i,j  ■  1,2,...}  be  a  set  of  iid  random  variables  with  E  w^  ■  0, 
o  / 

Elw,,  I  <  ".  For  each  n,  let  W  denote  the  pxn  matrix  whose 
'11'  n 

(i,j)-entry  is  w^  ,  here  p  *  p(n)  satisfies  p/n  - — *•  y  e  (0,«),  as 
n  -*•  «°. 


Then  there  exists  a  sequence  of  positive  numbers  6  *  6^  such  that 

1.  6->0,  as  n  +  «, 

2.  p(wn  W  »  i.o.)  =  0;  here  Wn  is  the  pxn  matrix,  with  the  (i,j) 
Wijn  Wij  *{  |  Wy  |  <  6nr}  ’ 

and  the  convergence  speed  of  <5  to  zero  can  be  slower  than  any  pre¬ 
assigned  speed. 

In  order  to  prove  Theorem  2.1,  we  need  some  combinatorics.  Let 

i^,^ . i2km  be  a  ae9uence»we  define  a  multigraph  T(k,m;  i^,...,^^) 

as  follows : 

1.  The  vertices  of  this  graph  are  i^*^*  •  •  •  »*2km*  **ome  the111 


may  be  equal. 


2.  There  are  2km  edges  e^,e^, . . .  ,el 


'2km* 


The  ends  of  e  are  i  and 


1  ii  do,  *  i,).  Any  two  of  these  edges  are  different  even  when 

a+1  L  KJB+l  X 

they  have  the  same  end  sets.  Sometimes  we  write  i  i  . ,  Instead  of  e  . 

a  a+1  a 

3.  To  each  edge  e&  there  corresponds  a  number  dir(eft),  called 

the  direction  of  e  ,  such  that 
-  a 


dir 


1+1,  if  [(a-l)/k]  is  even, 
(e  )  -  ‘ 

a  1-1,  if  [(a-l)/k]  is  odd. 


entry 
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Two  edges  e  ■  i  i  ,  ,  e.  ■  i-i.^,  are  said  to  be  coincident,  if  either 
a  a  a+1  b  b  b+1 

W  1a+l  *  1b+l  and  dir(ea)-dir(eb),  or  ia+1  "  ^  and  dir(ea>  -  -dir(eb>. 

A  chainisa subgraph  with  vertex  set  (ia,ia+1, . . .  ,ib>  (1  <_  a  <  b  2mk+l) 

and  edge  set  ^ea»ea+i » •  •  •  *  We  wi^1  denote  sucl>  a  chain  by 

i  i  . ,  • » •  i,  . 
a  a+1  b 

In  the  graph  r(k,m;  i^,  ^  . . .  «  we  classify  the  edges  as 

follows. 

1.  An  edge  i  ,i  is  called  an  innovation  if  i  is  new,  i.e.  i  +  i. . i  /  i 

0  a-1  a  a  .  a  1  a  a-. 

The  set  of  all  innovations  will  be  denoted  by  I. 


2.  Let  S  be  the  set  of  all  edges  ia  ^ia  which  coincides  with  an 
innovation,  and  for  any  b  <  a,  ij,-i*b  does  not  coincide  with  that 
innovat ion . 

3.  All  other  edges  consist  a  set  called  T. 

If  lala+1»  i^i^^  are  two  ed8es  satisfying  the  following  properties: 

(T)  b  <  a; 

(2)  i-i,.-  is  single  up  to  i  ,  i.e.  it  does  not  coincide  with  any 

D  DtJ.  A 

edge  of  the  chain  ■ 

(3)  Either  ife  -  ia  and  dirU^)  -  dir(iaia+1).  or  i^  -  l& 
and  dir(ibib+^)  *  -dir(ia»ia+1) ,  then  we  say  that  ia*a+1  i» 
coincldable  with  i,i.  ... 

D  t>-rl 

An  edge  of  S  is  called  singular  if  it  is  coincidable  with  just 
one  innovation. 

An  edge  of  S  is  called  regular  if  it  is  not  singular,  i.e.  it  is 
coincidable  with  more  than  one  edge. 

The  proofs  of  Lemma  3.1,  3.2,  3.3  below  are  similar  to  the  proofs 
of  Lemma  3.1,  3.2,  3.3  in  Yin-Bai-Krishnaiah  (1984). 

Lemma  3.1.  If  in  the  chain  iflia+1  •••  Vii+1  iS  single  up  Co 
ib  and  ib  has  been  visited  by  i^i^  —  lfl  then  *a *-a+i  —  contains 


an  edge  of  T. 
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Lemma  3.2.  Let  t  be  the  number  of  equivalence  classes  of  T  under 

the  equivalence  relation  "coincidence".  Then  if  is  a  regular 

edge  of  S,  the  number  of  edges  with  which  i  i  ,,  is  coincidable  is  not 

a  a+i 

greater  than  t  +  1. 

Lemma  3.3.  The  number  of  regular  edges  of  S  is  not  greater  than 
twice  the  number  of  edges  in  T. 

The  chains  ^  =■  ijij  . . .  ikik+1 ,  Lj  -  •  •  •  i2k+l’  *  *  *  ’ 

L2m"1(2m-l)k+l1(2m-l)k+2  ***  Wl  are  Called  Se*ment8* 

Lemma  3.4.  Let  i.  be  the  number  of  innovations.  Then  the  number 

of  different  ways  to  appoint  the  2km  edges  to  be  of  I,  or  S,or  T,  does 

.  ,  ,2km.  . .  2km-2i+2m 

not  exceed  (  )  (k+1) 

Proof.  Since  the  number  of  innovations  are  i ,  the  numbers  of  S 

2km 

and  T  must  be  8,  and  2km -2i,  respectively.  So  there  are  (  )  different 

ways  to  select  2km  -  2i  edges  from  the  2km  edges  which  are  appointed 

to  be  of  T,  and  the  others  to  be  of  1  or  of  S. 

Now  consider  a  segment  Lc<  Note  that  every  edge  in  the  same 

segment  has  the  same  direction.  Suppose  that  L£  contains  edges  of  T. 

Then  Lc  is  split  by  these  yc  T-edges  into  at  most  yc  +  1  subchains 

consisting  of  consecutive  edges  of  I  (JS.  Let  the  lengths  of  these 

subchains  be  vi»v2»“’’»v  +^,  respectively  (if  there  are  less  than 

pc 

Pc  +  1  such  chains,  then  some  v^  at  the  rear  part  of  this  list  are 
zero).  Consider  the  i-th  subchain  with  v^  edges.  It  is  evident  that 
if  some  edge  in  this  chain  is  of  I,  then  the  next  one  (if  any)  must  be 
of  I  because  of  the  same  direction  of  them.  So  there  are  only  v^  +  1 
possible  appointments  for  this  chain,  namely.  III  ...  I,  SII  ...  I, 

SSI  ...  I,  SSS  ...  SI,  SSS  ...  S.  So  for  the  whole  segment  Lc,  there 


are  at  most  T^+l)  <  (k+l)Pc+1  ways  to  appoint  the  k  -  non-T 

edges  to  be  of\  or  of  S.  2Jhus,  for  the  whole  graph,  there  are  at 

2m  Hc+1  Jti  Wc+2m  *  (k+l)2taD‘2S'+2m  ways  to  appoint 

most  n  (k+1)  *  (k+1) 

the  2fc  non-T  edges  to  be  of  I  or  of  S. 
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4.  PROOF  OF  THEOREM  2.1 


Now  we  apply  the  truncation  lemma  for  r  *  ^  and  p(n)  =  n.  We 
need  only  to  prove 


W  k  * 

lim  sup  |  |  (— )  ||  £  (k+l)a.  a.s. 


(4.1) 


n-*» 

Define  w . .  *  w 

ijn 

We  shall  prove  that  for  any  k  >  1 


ijn  "ijn  ~  E  wijn  and  def  1116  Wn  “  ^wijn^  ’  “  1»2»  •  •  •  »n* 


lim  sup  |  |  (  —  )k|  |  £  (k+l)ok  a.s. 

SR 


(4.2) 


n-*<» 


If  (4.2)  holds  for  any  k  >_  1,  since 


Wn  k. 

(  ) 

SR 


W  w 
(  )k 
SR 


w. 


(  *n  )k  _  (  W°  )ki 
“ '  '  ”  SR  ' 


►  n 

ft, 


k-1  0  WO 

<  I  lie  -£  ^11  1 1-£  -  -^1 1  ll(^) 

51=0  /n  Sn  Sn  SR 


n  ,  k-H-1 1 


and 


I  ills.  ^1 
v^r  ~  sn 

by  (4.2)  we  obtain 


lim  sup 
n-*°° 


|E  WllJ 

SR 


Wn  k. 
(  —  ) 


1  I  1  I  •  •  •  I  1 

1,1,;;:,! 
[i»i* • • • *ij 


Wn  1 
(  —  ) 


■  E  w 


lln1 


0, 


£  lim  sup  l  ||(  —  )  ||  |E  w  |  (k-Jt)c 
n->“  H=0  SR 


k-H-1 


(4.3) 


from  which  and  by  induction  we  can  deduce  (4.1).  Hence  to  prove 
Theorem  2.1,  we  need  only  to  prove  (4.2). 

For  saving  notations,  we  can  assume  that  W^  is  an  n x n  matrix  with 


iid  random  entries  w^ ,  such  that 


E  wn  *  0,  |wn|  £  5/n,  E  w^  <  1. 


'11 


2 

11 


(4.4) 
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a  •  •  W,  I  )  •  •  «  (w,  ,  a  a  a  W  ,  J  )  • 

2k+l  2k  1(2m-l)k+21(2m-l)k+l  A2mk+1  2mk 

Here,  i^.i^,  • .  ..ij^  run  over  {l,2,...,n}  and  i^mk+l  ”  il’  For  each 

i, ,i_, . . . ,1-  ,  we  can  define  a  graph  r(k,m)  as  in  Section  3. 

X  i  2mk 
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Now  we  estimate  the  expectation 
m-1  k 

M  =  E  n  II  (w.  w  w.  w  )  . 

a=0  b=l  2ak+b  hak+b+l  (2a+l)k+b+l  1(2a+l)k+b 

where(i,  .i^, . . .  ,i2km)  forms  a  canonical  graph(i.e.  i  <_max(i^,...  ^ _^Va,  and  ij»l) . 

Suppose  that  in  the  graph  r  (k,m;l^,  , . . .  »i2Jan^ 

1.  There  are  2  innovations 

2.  There  are  p  innovations  which  coincide  with  some  T-edges,  and 
the  number  of  T-edges  which  coincide  with  the  i-th  innovation  of  this 
kind  is  n^,  i  =  l,2,...,p. 

3.  There  are  t  equivalence  classes  of  T-edges  split  by  the 
relation  "being  coincident". 

4.  These  classes  in  3  which  do  not  contain  any  innovation 

have  . . . ,mt_^  edges  respectively,  (m^  >_  2,  i  *  1,2, . . . ,t-p) . 

It  is  easy  to  see  that 


M 


(e  n  E  w  ni+2  n  E  w  , 

i=l  X  j  =  l 


and 


U  t-p 

2 (2-p)  +  £  (n  +2)  +  £  m, 

i*l  j-1  3 


So  by  (4.4)  and  (4.5),  we  obtain 


2mk. 


|m|  ±  dV  (6/^)2km"2Z“t:  <  mt  (6/n  )2km"2a_t  (4.8) 

for  n,  hence  for  m,  large  enough. 

Now  we  estimate  the  sum  E  of  all  expectations  whose  graphs 

n 

r(k,m)  do  not  have  single  edges. 

Let  2  denote  the  number  of  innovations  of  the  graph  F(k,m).  Then 

there  are  2  S-edges  and  2km-22  T-edges.  For  a  fixed  canonical  graph 

2+1 

T(k,m)  with  £  innovations,  there  are  n!  /  (n-£-l)  !  £  n 
graphs  which  correspond  to  this  canonical  graph. 


different 
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..  t  _  .  _ .  „  ,2km,  .  2km-2£  +  2m  .... 

By  Lenuna  3.4,  there  are  at  most  (  ^  )(k+l)  different 

ways  to  appoint  the  2km  edges  to  be  of  I  or  of  S  or  of  T. 

Let  t  denote  the  number  of  noncoincident  T-edges.  Because  our 

graphs  do  not  have  single  throughout  edges,  we  have  £  <_  mk  and 

1  <_  t  <_  2km-2n  if  £  <^  mk-1. 

Next  we  bound  the  number  of  different  ways  to  appoint  each  edge  in 
a  canonical  graph  with  given  positions  of  the  £  innovations,  £  S-edges 
and  2km-2£  T-edges  and  with  t  different  T-edges.  Since  each  edge  is  an 

element  of  the  left-upper  2km  *  2km  submatrix  of  V  so  there  are  at 

2  ^ 
most  2£  <nfferent  ways  to  appoint  the  t  different  T-edges 

into  their  2km-2£  different  positions. 


Each  innovation  in  a.  canonical  graph  is  uniquely  determined  by  the  edges  before  it , 
and  so  iseach  singular  S  edge.  By  Lemma  3.2  and  3.3,  there  are  at  most 
(t+1)  different  ways  to  appoint  the  regular  edges  of  S  to  their 

positions.  Here  we  should  note  that  whether  an  S-edge  is  singular  or 
regular  is  determined  by  all  the  edges  before  it. 


From  the  above  arguments  and  (4.8),  we  get 


l‘J  i  I  C>(k«> 
£■1 


2km-2i  . (2km)*.  2km-2i 
2km-2£+2m  £+1  r  (  „  )  t 

n  2  t 


.  ,  4km-4£  t  (Kj~  . 2km-2£-t 

x  (t+1)  m  (6/n  ) 


km+1  ^  ,2km.,,  ...2km-2£+2m  2kT2*  (2km)3t  (t+l)61®'61^210""2*^)"1. 
<  n  I  (,.)(k+l)  l 


here  T  A  *1,  convenlented  for  savins  notations, 
t-i  c 

By  the  elementary  inequality 

aC(t+l)b  <  (-  )b  for  (0  <  a  <  1,  b  >  0) 

—  log  a 


we  get 


I  km+1  *rk  ,2km.  ,,  .. 

V^n  l  <2  lHk+1) 

£»1 


2km-2£+2ra 


(2km) 


6km6 


1/6 


log 


fi/n 


(2toP 


6km-6£ 


If  we  select  m  *  m(n)  *  A(n)  log  n  such  that 
1.  A(n)  -►  00 


2.  A(n)  61/6  -*•  0 


then 


6kjn6 


1/6 


,  S/n 
log  TltoO3" 


0,  (n  -*■  »)  . 


Thus  we  obtain  for  large  n 


Iv 


km+2  ,2km 


I  ((k+l)25)km'£  (k+1) 


,  2m 


£-1 


2£ 


<  nkm+2  (1  +  (k+l)61/2)2kE  (k+1)2” 


.km 


Since  z  >  (1+k)  and  6  -*■  0,  we  have 
l  z-2°  n^lE  | 

n-1  n 

<C  J  (n2/m(l+(k+l)61/2)2k  (k+l)/z0)m 
n*l 

00 

r  m 

<.  c  l  T)  <  » 

n*l 

where  0  <  i>  <  1  is  a  constant.  Here  the  last  series  converges  because 
m/log  n  -*■  ». 


The  proof  is  finished. 
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5.  TWO  PROBLEMS  OF  GEMAN-HWANG 


In  Geman-Hwang  (1982),  they  suggested  the  following  system  of 


linear  equations  with  unknown  n  *  1  vector  X 


1  +  —  W  X 

n  j—  n  n 
/n 


(5.1) 


where  W^  is  an n  *  n  matrix  whose  (i,j)-entry  is  w^  and  W  *  {w^ : 

i,j  3  1,2,...}  is  an  infinite  matrix  of  iid  random  variables,  and  1^ 

T 

is  the  n*  1  vector  (1,1,...,  1)  . 

T 

If  Xn  *  ^nl'*“’^nn^  *  t^len  f°r  any  integer  m  >_  1,  Geman  and  Hwang 
proved  that  as  n  +  «, 


(Xnl*Xn2 . Xnm} 


under  the  conditions 


1.  E  w. 


0,  0  <  E  w.. 


N(1  ,  - y  I  )  weakly, 

«n  o 


2  1 
a  <  p 


(5.2) 


2.  ElW2il  5.  n0in  i°r  any  integer  n'2L  °  is  a  positive  constant. 
Geman  and  Hwang  pointed  out  that  the  computer  simulations  support 

(5.2)  even  in  the  case  of  uniform  distribution  on  [-1,1],  where 

2  1 

a  --j. 

2  1  4i 

We  will  prove  that  (5.2)  is  true  even  when  0  <1  and  E|w^|  <  «. 

Theorem  5.1.  Let  X  be  the  solution  of  (5.1)  whenever  (I  — —  W_) 

-  n  ^  n 

is  nonsingular,  otherwise  define  Xn  ■  0.  Then  (5.2)  holds  when 

E  »n  •  0,  E  -  o2  <  1  .nd  Elv^l  <  .. 

Geman  and  Hwang  (1982)  suggested  a  system  of  differential  equations 


X  (t)  -  aX  (t)  +  —  WX(  t ) ,  X  (0)  -  1  . 
v'n 


(5.3) 


They  proved  that  for  any  integer  m  1,  real  T>  °>  Xnl(*> . Xn«(-> 

(the  first  m  components  of  the  vector  Xft(.),  the  solution  of  (5.3)) 
tend  to  m  iid  Gaussian  processes  weakly, as  n  -*■  », on  [0,T],  Each  of 
these  0  processes  has  mean  u(t)  ■  ea£  and  covariance  function 


k-1  (k!) 


They  supposed  among  others  the  following  moment  requirement 

n  ftn 

E | Will  <_  n  for  all  n  ^  2,  and  some  6  >  0. 

In  the  same  paper,  they  conjectured  that  the  analogous  theorem 


should  hold  for  the  equation 


X  (t)  -  aX  (t)  +  —  X  (t)  +  1  ,  X  (0)  -  1  . 
n  n  y^n  n  n  n  n 


(5.4) 


We  will  prove 

2  4 

Theorem  5.2.  Suppose  E  w^  ■  0,  -E  w^  *  1,  and  E  w^  <  00 .  Let 

X  (t)  be  the  solution  of 
n 

X  (t)  -  cxX  (t)  +  —  W  X  (t)  +  6  1  ,  X  (0)  -  1  .  (5.5) 

n  n  r—  n  n  nn  n 

/n 

Then  for  any  integer  m  >_  1,  real  T  >  0,  X^(t) , . . .  »xnm(t)  tend  to  m  iid 
Gaussian  processes  weakly  on  [0,T]  as  n  The  mean  of  these 


processes  is 


u(t)  -  eat  +  0  j  e°S  ds  -  e0t  +  (eat  -  1)  ,  (5.6) 


the  covariance  function  is 


v  1  ,.k  at  .  „  I  kau  ,  w  kas  ,  „  kou 

C(t,s)  -  l  - j  (t  e  +  0  u  e  du)(s  e  +  0  u  e 

k-1  (k!)  ^0  J0 

(5.7) 

Remark.  When  0  »  0,  Theorem  5.2  reduces  to  an  extension  of  Geman- 
Hwang  theorem.  When  0  ■  1,  Theorem  5.2  includes  a  proof  of  Geman- 
Hwang's  conjecture. 
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6.  PROOF  OF  THEOREM  5.1 

By  Che  Truncation  Lemma;  we  can  assume  that  the  entries  of  W  are 

n 

bounded  by  /nfi ,  here  6  *  6^  -*■  0  arbitrarily  slow.  We  suppose  6  is 

defined  as  in  the  proof  of  Theorem  2.1. 

Write  Y  *  X  -  1  ,  A  ■  W  /*^T  .  (5.1)  is  equivalent  to 

n  n  n 

(I  -  A)Y  -  Al  . 
n  n 

¥  i 

Multiply  both  sides  by  2  A  ,  we  get 

i*0 

2  —  (I  -  Ak)Y  •  l  A*1  .  (6.1) 

n  n  ^  n 

We  need  the  following  lemma. 

Lemma  6.1.  Suppose 

1.  (w^;  i»j  *  1,2,...)  are  iid  random  variables;  and  Wq  is  the 

matrix  (w, 1  <  i,  j  <  n); 

ij  —  ~ 

2.  E  wu  -  0,  E  •  0  ,  E  wu  <  ». 

Then  if  a(i,k,n)  denotes  the  i-th  component  of  the  vector  (  —  )  ln» 

«^n 

for  any  distinct  ordered  pairs  (1,  ,k,) , . . .  ,(i  ,k  ) ,  as  n  -*■  «», 

ix  mm 

(a(i.  ,k.  ,n) . a(i  ,k  ,n))T  -£-*■  N  (0,A  )  , 

XX  mm  mm 

where  A  -  diag(o^kl, . . . ,0^^®) . 
m 

The  proof  of  Lemma  6.1  is  almost  the  same  as  the  proof  in  the 
Appendix  of  Geman-Hwang  (1982)  and  is  therefore  omitted  here. 

By  Truncation  Lemma  and  Lemma  6.1,  it  is  not  difficult  to  see  that 

k  j  j 

(1  0)Z  —  ■»  N  (0,  T  o  I  ),  as  n  (6.2) 

m  n  m  i»l  ® 

Here  I  is  the  m*m  identity  matrix.  Also,  if  (Z  )  is  the  i-th 
m  .  n  i 

tj  ™  e  j 

component  of  Z  ,  E(Z  )T  - ►  I  a  as  n  Here  the  reader  has  to 

n  n  1  i-1 

note  that  we  have  truncated  the  entries  of  W  at  Jn  6  . 


In  order  to  prove  Theorem  5.1,  we  notice  that 


X  =1  +  Y  =  1  +  Z  + 

n  n  n  n 


Then,  if  t  a  (t,  ,...,t  )T,  i  «  ^-T, 


a\. 


I e  .“''V’O.-V  -  r1/2  °2J| 

it’ (I  0)(x  -1  )  it:'(Im0)Zn| 

Ee  m  nn-Ee 


00 

E  eiC  ^m^Zn-  exp{  -*5  t't  £  o 2^}  I  +  (exp{  -h  t't  £  a2^}-expl  -*S  t 't  ^ 

J-l  11  J-l  J 


-  ax  +  a2  +  a3. 

As  n  -►  »,  a2  -*■  0,  by  (6.2). 

Now  we  estimate  a^.  We  have  for  any  e  >  0 

<_  E|  eiC '  (1m°) -  l\  <  2  P( |  |  (I^OM^I  |  i  e)  +  $(e) 
t  fx 

Here  $(e)  *  sup  |e  -  l|  0  as  e  -►  0. 

1 1*1 1±  * 

l/k 

We  consider  only  those  k,  for  which  (1+k)  o  <  1. 

It  k  l/k. 

Let  A  *  A  .  -  {w  e  fi:  | | A  | |  <  n  ),  where  (1+k)  a  <  n  <  1, 
n,K 

n  is  fixed.  Evidently  P(A)  1  as  n  »  by  Theorem  2.1.  Thus 

P( | | (Im0)AkY| |  >  e)  <  P<| | (Im0)AkY| |  1  e»  1 1 Ak| |  <  nk)  +  P(||Ak|| 

<-7  B|  |  (1m°)A’kYl  |2  1A  +  P(||Ak||  >  nk) 
e 

<  e|  Ia^I  I2  1A  +  1  -  p(6),  (6.3) 

e  n 

since  the  components  of  aN  1  have  the  same  distribution. 

We  have 

a\  -  Ak(I  -  Ak)Y  +  aVy  -  AkZn  +  Ak(AkY) , 


IIaSII  <  ||Ak||  llzjl  +  ||Ak||  IIaSII. 


IIaSii  1  <  llA  II 

1_l-||Ak|| 


iyi  S  <6-4 


By  (6.3)  and  (6.4), 


P( 1 1  (lmO)AkYl  |  >  e)  <-—  (~-2-^)  E|(Zn|[2  +  1  -  P(A) 

e  n  1  -  n 


Let  n  -*•  we  get 


lim  P( |  J  (I  0)AkVl  I  >  O  <  ~  (-D— j-)2  l  o2J. 

n—  m  "  “e2  l-nk  j-1 


11m  |e  ei,:'(Im0)(Xn"ln)-exp{-Js  t’t  X  o2J>  1 1  lim  a  + 

rr*®  OW 


)2  l  02i  +  4>(e>|exp{  -h  t’t  £  o2:i}-exp{  t 

l-n  j-1  J 


Letting  k  -*•  ®,  and  then  e  +  0,  we  see  that  the  left  hand  side 


tends  to  zero. 


7.  PROOF  OF  THEOREM  5.2 


It  is  easy  to  verify  that 


V‘>  -l  rr  <  7>k 

k*0  /n 


”  *  -  '-Kat  +  8 


fC  k  ai 
s  e 

J0 


ds)  (7.1) 


is  the  solution  to  (5.5). 

Theorem  5.2  is  a  consequence  of  the  following  lemma. 

Lemma  7.1.  Let  {w^ :  i,j  *  1,2,...}  be  a  family  of  iid  random 

2  4 

variables  with  E  w^  *  0,  E  w^  -  1  and  E  w^  <  <*>,  and  Wr  *  (w  , 

1  £  i  £  n,  1  £  i  £  n)  . 

Let  {g^(.),  k  *  0,1,...}  be  a  sequence  of  continuous  functions 


satisfying 


<»  k 

l  L7  sup  Im^I  <  •» 


(7.2) 


k-0  0<t<T 


here  r  >  2,  T  >  0  are  positive  constants. 

Then  for  any  integer  m  >_  1,  as  n  -*■  <*>  the  stochastic  process 

oo 

_  1  Un  k 

(Im0)  l  -jy  (  ~)  lR  t ) ,  t  e  {0,T],  tends  to  an  m-dlmensional 


m  '  .  k!  r- 

k»0  /n 


Gaussian  process  with  iid  components,  each  with  mean  g^(t)  and 

OO 

X  2 

covariance  function  c(t,s)  *  \  (■jy)  g^(t)  g^(s) . 

k=l 

Proof .  Let 

00 

z-(t)  ■  «„i(t> . z™(t»T-  I  rr(“)ki„8v<o. 


nn 


k-1 


k! 


/S 


n  6k' 


We  prove  that  the  sequence  {(Z  -(.),..., Z  (.)),  n  *  1,2,...}  of 

nl  nm 

stochastic  processes  is  tight  in  (^[O.t].  It  is  easy  to  see  that  we 
need  only  to  show  that  (Zn^(.),  n  ■  1,2,...}  is  tight  in  C[0,T],  1  ^  i 
Let  4  -  {id  e  fl:  |  |— |  |  (u>)  £  r}.  By  Theorem  2.1,  P(A  )  1. 


6 


t,s  e  10, T] 
wn  k 

r  /  11  ^  i 


wn  ,k 


a(i,k,n)  -  {(  — )  lK  -  the  i-th  component  of  (  —  )  1Q- 


We  have 


sup 

lt-sj  <  6 
t,s  e  [O.T] 


| Z  .(t)  -  Z  (s)i  1  I  |ot(i,k,n)| 


P  («) 


-ni  “k-1  k! 


hence 


lto  lim  P(  sup  |ZQi(t)  "  zni^S  > 

6+0  n-*~  |  t-s|  <  6 

t,s  e  T 

.  _  ® 

£  lim  lim  P(  I  |a(i,k,n)l  -  >  O 

5- +-0  ir*®  k*l  k! 

PV(«) 

<  lim  lim  [  -  E  l  1.  (o(i,k,n)|  -  +  (1  -  p<An>>  J 

6- *-0  i**®  E  k*l  n  k* 


00  p  (6) 

m  li m  lim  “  £  1  E  1*  (a(i*kfn)| 


6-*0  «-♦«  k~l  k! 


It  is  easy  to  see  that  a(i,k,n)  1  . a(n,k,n)  1^  ,  i-1,2 . .  i  ave 

n  n 

identical  distribution.  Therefore 

il,  l«(t.k,n)|  «  E1/2  14  |a(i»k,n) | 2 

<  i^l4nll(^>kl„H2>1/2 
<1.1*  ll%|2,‘)1/2-t- 

n  »n 


lim  lim  P(  »up  lzni<t) 
6+0  n~»  | t-sj  <  5 

t,s  e  T 

l  r  pk(6)  k 

<  lim  -  l  — -  r  -  0. 

6-*-0  e  k“l  kt 


Zni(st|  >  e) 


Thus,  the  tightness  of  the  family  {Zni(.);  n  =  1,2,...}  of 
stochastic  processes  is  established. 

Finally  we  show  that  for  any  positive  integer  l  and 


t1,...,tJl  e  (OfTj ,  as  n 
m  l 


mil 


exp<1  Ji  j1-!  ~  “p{  ii  ih  V«.  C<V' 


here  i  *  /-T  and  {AVj}  are  real  numbers. 


n  v  WnJt  8k(t) 


k-J+l  /£  ”  V  k! 

r  8k(t) 

2,  o(v,k,n)  -  ,  v  -  l,...,n. 

k-p+1  k! 


Let  g,  -  sup  g,(t).  Then  for  any  e  >  0, 
te[0,T] 

oo  o 

lim  lim  P(|e*|  (t  )  |  >  e)  <  lim  lim  £  r~  E  1  |a(v,k,n)| 

p-x»  n-K»  ^  p+«  n-*»  k-p+1  n 


.  _  «  k 

-  7  lim  E  ft  *k  "  °* 

p-~  k-p+1  * 


On  the  other  hand,  by  (7.2) 


lim]  I  — ^  g  (t  )g  (t  >|^  lim  (  J  —1-0.  (7. 

p-**>  k-p+1  (k!)  J  **  p-«»  'k-p+l  (k!)  ' 


We  have 


_<  E  exp 


'  ml  «  g,  (t . ) 

i  I  £  A  £  o(v,  k,  n)  — r~.  ’ 

jii  v-i  k-i  k!  S 

[  -  m  l  2 

exp<-  t  t  7  7  X  A  c ( t  ,  t  )' 

\  2  vi  1  jil  qfl  ^  J  «  j 
t  ??  *  *  8k(t^ 

V  I  I  x  I  a(v,  k»  n>  — kf3- ' 

(  v-1  j-1  k-1  K! 


(  «  j  !  gk(t.) 

-  E  exp  A  y  l  \  l  a(v,  k,  n)  -rr  3 
I  v-1  j-1  k-l 


(7.3) 


E 


By  (7 


f  “  i  ?  gk(t1)l 

+  E  expji  l  l  X  l  a(v ,  k,  n)  J  ( 
1  v-1  j-l  k-1  J 

?  r  i 


-  exp 


*  IH  -  *  j,  Jjj.vi  ^*1 

(  .  m  £  £  ■»  | 

-  exp)-  -r  £  £  £  X  X  c(t,t)[ 

I  2  v-1  j-l  q-l  vq  i  «*  !! 


-  at  +  a2  +  ar 

.3)  lim  11m  a,  -  0.  By  Lenina  6.1,  lim  a_  -  0.  And 
p-*»  n*» 


*3  * 


-  exp 


•"'Uni 

HI  j,  J.v*  w-v] 

< ,  m  £  £  i"  •  2,  >  o 

«P  T  t  l  II\JI\j(  I  §  2,—  o 

«■  v-1  j-l  q-1  Vj  Vq  lk-l  ± 


1  -  exp 


,  as  p 


by  (7.4).  We  finish  the  proof. 
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